Probing Patient Messages Enhanced by Natural Language Processing: A Top-Down Message Corpus Analysis

Web Text Corpus for Natural Language Processing

Web text has been successfully used as training data for many NLP applications. While most previous work accesses web text through search engine hit counts, we created a Web Corpus by downloading web pages to create a topic-diverse collection of 10 billion words of English. We show that for context-sensitive spelling correction the Web Corpus results are better than using a search engine. For t...

Corpus Design For Biomedical Natural Language Processing

This paper classifies six publicly available biomedical corpora according to various corpus design features and characteristics. We then present usage data for the six corpora. We show that corpora that are carefully annotated with respect to structural and linguistic characteristics and that are distributed in standard formats are more widely used than corpora that are not. These findings have...

Disambiguating Verbs by Collocation: Corpus Lexicography meets Natural Language Processing

This paper reports the results of Natural Language Processing (NLP) experiments in semantic parsing, based on a new semantic resource, the Pattern Dictionary of English Verbs (PDEV) (Hanks, 2013). This work is set in the DVC (Disambiguating Verbs by Collocation) project aimed at expanding PDEV to a large scale. This project springs from a long-term collaboration of lexicographers with computer ...

Top-Down Discourse Predictions in Natural Language Generation

Top-down Natural Language Query Approach for Embodied Conversational Agent

This paper describes research work in implementing a conversational intelligent agent on the web focusing on a top-down natural language query approach. While the present World-Wide Web provides a distributed hypermedia interface to the vast amount of information on the Internet, there is a lack of appropriate metadata to that content. Instead of being a giant library as intended, increasing se...